Redundant media packet streams

ABSTRACT

This invention concerns the transmitting and receiving of digital media packets, such as audio and video channels and lighting instructions. In particular, the invention concerns the transmitting and receiving of redundant media packet streams. Samples are extracted from a first and second media packet stream. The extracted samples are written to a buffer based on the output time of each sample. Extracted samples having the same output time are written to the same location in the buffer. Both media packet streams are simply processed all the way to the buffer without any particular knowledge that one of the packet streams is actually redundant. This simplifies the management of the redundant packet streams, such as eliminating the need for a “fail-over” switch and the concept of an “active stream”, The location is the storage space allocated to store one sample. The extracted sample written to the location may be written over another extracted sample from a different packet stream previously written to the location. These extracted samples written to the same location may be identical.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/824,734, filed Nov. 28, 2017, which is a continuation of U.S. patentapplication Ser. No. 14/539,575, filed Nov. 12, 2014, now U.S. Pat. No.9,860,291, which is a continuation of U.S. patent application Ser. No.13/784,308, filed Mar. 4, 2013, now U.S. Pat. No. 8,913,612, which is acontinuation of U.S. patent application Ser. No. 13/152,815, filed Jun.3, 2011, now U.S. Pat. No. 8,411,679, which is a continuation of U.S.patent application Ser. No. 12/308,168, filed May 28, 2009, now U.S.Pat. No. 7,978,696, which is the National Phase of InternationalApplication No. PCT/AU2007/000667, filed 17 May 2007, which furtherclaims the benefit of Australian Provisional Application Nos.2006902741, filed 17 May 2006 and 2006906015, filed 19 Oct. 2006. Eachof these applications, in their entirety, are incorporated herein byreference.

TECHNICAL FIELD

This invention concerns the transmitting and receiving of digital mediapackets, such as audio and video channels and lighting instructions.These media channels are transmitted as media packets from a transmitterdevice to a receiver device for playout. In particular, the inventionconcerns the transmitting and receiving of redundant media packetstreams. The invention concerns a transmitter device, a receiver device,a data network, method of receiving a media packet stream and computersoftware to perform this method.

BACKGROUND ART

Media channels, such as audio and video channels, have long beentransmitted using application specific cables. For instance, two-corespeaker cable is used to carry left and right audio channels fromamplifiers to speakers.

More recently, media signals have been transmitted on computer basednetworks using protocols such as unicast or multicast. Unicast is amethod of sending packets on a computer network to a single destination.The unicast packets must be retransmitted for every media device thatwishes to receive the packets.

Multicast is typically used to refer to IP multicast, which is aprotocol for efficiently sending to multiple receiver devices at thesame time on TCP/IP networks by use of a multicast address. The computernetwork then operates to route the packets to each of the devices on thenetwork that wish to receive the multicast packets.

Media networks can allow for redundant media packet streams to betransmitted and received. It is known for the transmitter to continuallyprocess the primary media packet stream and simply ignore the redundantcopy of the media packet stream. In the event that a problem is detectedin the primary packet stream (i.e. a broken transmission path in thenetwork) a “fail-over” switch is enacted. Once the switch is activated,the receiver device then ignores the primary media packet stream andprocesses the redundant copy.

SUMMARY OF THE INVENTION

In one aspect the invention provides a receiver device for receivingmedia packet streams from a data network, the receiver devicecomprising:

-   -   a first data interface to receive a first media packet stream        containing samples of a media channel;    -   a second data interface to receive a second media packet stream        containing the samples of the media channel;    -   a processor to extract samples from the first and second media        packet streams and to determine an output time for the extracted        samples;    -   a buffer to temporarily store the extracted samples for output;        and    -   wherein the processor operates to cause the extracted samples to        be written to the buffer based on the respective output time,        such that extracted samples having the same output time are        written to the same location in the buffer.

In this way the receiver device simply processes both media packetstreams all the way to the buffer without any particular knowledge thatone of the packet streams is actually redundant. This simplifies themanagement of the redundant packet streams, such as eliminating the needfor a “fail-over” switch. Further, the concept of an “active stream” isno longer required.

The buffer may be designed to store a predetermined maximum number ofextracted samples in sequential order according to the output time ofeach extracted sample. The location is the storage space allocated tostore one sample. A first extracted sample written to the location maybe written over a second extracted sample from a different packet streampreviously written to the location. The first and second extractedsamples written to the same location may be identical.

The buffer may be associated to one output channel and each media packetstream may be directed to the same output channel. Each media packetstream may contain two or more media channels. The receiver device mayfurther comprise a third data interface to receive a third media packetstream containing the samples of the media channel, wherein theprocessor further operates to extract samples from the third mediapacket stream and to determine an output time for the extracted samples.Since there are no special management controls required to process theredundant packet stream, the number of redundant packet streams caneasily be increased and all processed in the same way.

The first and second media packet streams may be received from differentdata interfaces from the same transmitter device connected to the datanetwork.

The processor may further operate to detect samples that are corruptedand to prevent these corrupted samples from being written to the buffer.All the samples contained in one media packet of the first media packetstream may not be contained in any single media packet of the secondmedia packet stream.

Even if the samples of the two media streams are not packetized in thesame way the processor operates to extract and write the samples in thesame way regardless.

Samples of the media channel may have an associated timestamp and theprocessor may operate to determine the output time of the extractedsamples based on the respective timestamps. The timestamp may be anabsolute time stamp and may represent the sampling time.

The invention may further comprise a method of receiving media packetstreams from a data network, the method comprising the steps of:

-   -   receiving a first media packet stream containing samples of a        media channel;    -   receiving a second media packet stream containing the samples of        the media channel;    -   extracting samples from the first and second media packet        streams; determining an output time for the extracted samples;    -   based on the respective output time, writing the extracted        samples to a buffer for output, such that extracted samples        having the same output time are written to the same location in        the buffer.

In a further aspect the invention provides computer software to operatea receiver device to perform the method described above.

In yet a further aspect the invention provides a transmitter device fortransmitting media packet streams on a data network to a receiverdevice, the transmitter device comprising:

-   -   one or more data interfaces to transmit a first media packet        stream and a second media packet stream to the receiver device,        the media streams containing one or more media channels;    -   based on a request from the receiver device, a processor to        packetize media channels to create media packet streams for        transmission from the data interfaces; and    -   a controller to cause the processor to create two independent        media packet streams containing the same media channels to be        transmitted to the receiver device.

The request may be to address a first media packet stream containingmedia channels to a first interface of the receiver device and a secondmedia packet stream containing the same media channels to a secondinterface of the receiver device. The request may be a single messagereceived from the receiver device.

The transmitter device may comprise a first data interface to transmitthe first media packet stream and a second data interface to transmitthe second media packet stream.

The data network may be comprised of first and second data sub-networks.The controller may cause the first media packet stream to be transmittedon the first data sub-network and the second media packet stream to betransmitted on the second data sub-network.

In this way, if one data network fails to successfully pass one or morepackets then the same media channels are passed via the othersub-network and no data loss occurs. Further the first data sub-networkmay have a different configuration to the second data sub-network, suchas different transmission protocols.

The invention also concerns a method and software for transmitting twomedia packet streams containing the same media channels to the receiverdevice.

In yet a further aspect the invention provides a computer networkcomprising a receiver device and a transmitter device as describedabove.

BRIEF DESCRIPTION OF THE DRAWINGS

Examples of the invention will now be described with reference to theaccompanying drawings in which:

FIG. 1 is a schematic diagram of a network that can be used with theinvention;

FIG. 2 is a schematic diagram of single packet of a media packet streamsent on the network using the invention;

FIGS. 3(a) to 3(d) is a schematic view of how redundancy can beimplemented in the data network;

FIG. 4 is a schematic diagram of the network using redundant interfacesin accordance with an embodiment of the invention;

FIG. 5 is a further schematic diagram of a network using redundantinterfaces in according to a further embodiment of the invention; and

FIG. 6 is a schematic diagram of a buffer of an output channel of thereceiver device.

BEST MODE OF THE INVENTION Overview of the Components of the Network

Referring first to FIG. 1, a data network is described. The data network100 comprises a transmitter device 110 and a receiver device 112. Theremay be a plurality of transmitter devices 110 and receiver devices 112on the network 100, but only one of each is discussed here for clarity.Further, the devices 110 and 112 may be able to perform bothtransmitting and receiving functions, but they are described here asonly performing one function each again for better clarity.

The transmitter device 110 and the receiver device 112 are connected toeach other by a network 114 so that they are able to send and receivedigital media packets as part of a media packet stream. The transmitterdevice 110 is comprised of an Audio Processing Engine (APE) 120 and anAudio Processing Engine Controller (APEC) 122. The receiver device 112is also comprised of an APE 124 and an APEC 126. The media packets aresent in media packet streams that can contain one or more mediachannels. For simplicity, the embodiments describe all media channels ina media packet stream to be the same format however the invention canaccommodate for multiple media channel formats within the one mediapacket stream.

A media device 140, such as a guitar, is connected to the APE 120 andthe APE 120 receives the media signals generated by the media device140. A preprocessor (not shown) may be added to convert the mediachannel from analogue to digital or convert from one digital format toanother (e.g. sample rate or bit depth conversion). The APE 120 thenpacketizes the digital media channel. The resulting packet stream issent using the network 114 to the APE 124 of the receiver device 112.The APE 124 then de-packetizes the digital media signal, (if suitable)converts it to analogue and transmits the analogue media signal to themedia device 142, such as a speaker for playout. Conversion will not benecessary when the media signals are non-analogue sources, such as aMIDI sources. The rate and offset of packetization and transmission istightly controlled in time to ensure that the playout of the mediasignal by the media device 142 is synchronized with the playout of themedia signals by another media device (not shown) connected to thenetwork 114 that also received the media signal from the APE 120. Thepacketization operation of the APEs 120 and 124 is described in detailin the co-pending PCT application PCT/AU2006/000538 (WO 2006/110960).Reference is also made to the co-pending PCT application filed this dayclaiming priority from AU2006906015 and AU2006902741.

An APEC 122/126 is a component implemented in software or hardware. Inthis network 100, the APEC 122/126 is on the same physical device as theAPE 120/124, but alternatively may be located remotely from the APE120/124 such as on another device or a central computer connected to thenetwork 114. An APEC 122/126 provides the user with an abstract view ofthe APEs 120/124 and any audio devices 140 and 142 connected to them. Atransmitter device 110 has a number of transmittable channels that canbe named and then made available to receiver devices 112 on the network114; this is called advertisement. A receiver device 112 has a number ofreceiving channels. A named transmitting channel can be assigned to areceiving channel; this is called subscription. APECs 122 and 126 willconfigure the APEs 120/124 to cause the media signals to be routed fromthe transmitting channel to the receiving channel.

The receiving and transmitting APECs 126 and 122 exchange configurationinformation and control messages over the network 114. Configurationinformation is exchanged via a service discovery database 118, such asDNS-SD. This database may be implemented in a distributed manner witheach device 110 and 112 storing and providing the configurationinformation associated with its APEC 122/126. Additional controlmessages are sometimes required to complete the subscription process andcause media signals to be routed. These are sent between the receivingAPEC 126 and the transmitting APEC 122.

Each APEC 122/126 configures its own APE 120/124 and interacts withother APECs 122/126 to ensure that configurations match betweencommunicating APEs 120/124.

Inside each device 110 and 112, input channels such as the channel fromaudio device 140 are known as “TX channels” because they will betransmitted over the network, and output channels such as the channelthat is sent to audio device 142 are known as “RX channels” because theywill receive data from the network.

Initially, the devices must be connected to create the network 104.Referring to FIG. four media devices, a keyboard 144, a guitar 140, aleft channel for a CD 146 and aright channel for a CD 148, are connectedto the four input channels of the transmitter device 110. In thisexample the keyboard and guitar use the same sample rate and sampleformat (say 48 kHz. 24 bit, PCM encoded). The CD channels have adifferent sample rate and sample format (say 44.1 kHz, 16 bit, PCMencoded).

Media Packet Stream

Referring now to FIG. 2 which schematically shows a single media packet550. Multiple media packets sent in sequence form a media packet stream.Each media packet 550 of the same media stream is comprised of the samemedia channel(s). Each media packet 550 is comprised of frames 554. Eachmedia channel must be assigned a sample space 556 in each frame 554 ofthe media packet 550. This sample space is also called a slot. Eachpacket 550 has one slot per channel and thus one sample space 556 perframe 554.

Each frame 554 has associated with it an absolute time stamp that isalso recorded within the packet. The concept of time is synchronizedacross all devices 110 and 112 across the network 100 so that they sharea common clock. All devices 112 that control the playout of the mediachannels contained within a frame 554 must playout the channels of eachframe in synchronization. This is done based on the timestamp of eachframe 554. For example, each playout device may playout the samples 556of each frame 554 at a predetermined delay past the absolute time stampwith reference to the common clock.

Redundant Media Packet Streams

Redundancy will now be described with reference to FIG. 4. Redundancy isachieved by duplicating packet streams over different interfaces of anetwork device. Redundancy is mainly controlled at the APEC layer. AnAPEC can program a given packet stream on the APE to be sent or receivedon a particular data interface. If a particular media packet stream isto be transmitted redundantly then the APEC programs two or more copiesof the packet stream. One copy to be sent from the first interface 130of the APE 120, and a second copy of the packet stream to be sent fromthe second interface 136 of the APE 120.

Similarly, the receiving APEC 126 programs its APE 124 to receive a copyon each data interface 132 and 134. Each duplicate packet stream isprogrammed to provide samples to the same output channels. This meansthe packet streams are written to the same buffer. Since the samples andtheir determined output times are identical for both packet streams,identical samples are processed and overwritten in the buffer for theoutput channel. Normally, this would result in errors and raceconditions. However, since all redundant media packet streams containidentical samples having synchronized output times it does not matterwhich sample data of which media packet stream is written first to thebuffer, as only one copy of each sample will actually be sent to theoutput channel since all duplicates are simply overwritten.

The output time dictates where in the buffer the sample is written to.The output time is for a sample is determined based on the timestampassociated with the sample in the media packet stream. This may includecompensating for delays and offsets of each media packet stream. Notethat timestamping every sample of a media channel does not require thata physical timestamp be added to every sample. If 20 samples of periodicaudio data from a single media signal are sent in a packet, then simplytimestamping the first sample also implies the timestamps for the rest.The remaining samples therefore have a timestamp by association.

FIG. 3 shows some of the ways in which redundancy can be implemented ona data network. The interfaces can be connected to independent networks114(a) and 114(b) or to a single network 114 via multiple paths.Interfaces 138 and 139 in FIG. 8(c) are the second redundant interfacesof the transmitter 110 and receiver 112 respectively. FIG. 8(d) showsthat the one interface on the transmitter 110 can transmit to separateinterfaces on the receiver 112.

APEs 120 and 124 with multiple channel data interfaces each designateone interface as primary. This is interface #0. Any further (redundant)channel data interfaces are numbered from 1. For example, the APE 124 ofFIG. 4 with one primary 132 and one redundant 134 interface hasinterfaces #0 and #1.

When transmitting or receiving, for simplicity APEs 120 and 124 areconfigured to only send or receive to equivalent interfaces. The primaryinterface 130 on one APE 120 communicates with primary interface 132 onthe other APE 124. Interface 136 #1 on one APE 120 communicates onlywith interface 134 #1 on the other APE 124. And so on. This allows eachAPE interface to be marked externally. For example, on the hardwareitself, the primary interfaces might be coloured black, first redundantinterfaces as red, secondly redundant interfaces as blue, and so on.This makes it easy for a user to distinguish between the differinginterfaces and ensure they are wired correctly during set up.

Redundancy in the Unicast Protocol

A media channel is advertised on the network 114 to indicate that areceiver can subscribe to it using the unicast protocol. The receivercan request to receive the TXT record for a media channel that includesdetailed information of the media channel, including the sample rate,bit depth and encoding (1=PCM). The “txtvers” field is a version numberfor the TXT record. The “nchan” field is the maximum number of channelsper dynamic bundle. Stage-box 110 has a maximum of four channels perdynamic bundle, enough to send all inputs 144, 140, 146 and 148 in asingle packet. The id field is an arbitrary physical channel identifierused by the APEC 120 to tersely identify its channels. The channel named“keyboard” happens to have ID 16. Outside the transmitting APEC 120,this ID is only useful to a receiver APEC 124 configuring a dynamicbundle on APEC 122.

The TXT record of the advertisement includes a field, marked say “nred.The value of “nred” indicates the number of redundant interfaces. Ifomitted, the value is treated as zero. A value of zero indicates noredundant interfaces meaning that the APE 120 of the transmitter 110supports a primary data stream only. A value of 1 indicates a singleredundant interface. Values greater than 1 indicate multiple redundantinterfaces (numbered 1 . . . n).

Rather than send a single dynamic bundle request, the receiving APEC 126may also send one request per interface available on the transmitter,each with a different interface field. Alternatively, the request forthe redundant stream to the redundant interface may be incorporated intothe original request message for the packet stream to the non-redundantinterface.

As shown in FIG. 4, stage-box 110 has a redundant interface 136 (#1) inaddition to the primary interface 130 (#0). The TXT record of thechannel advertisement is now formatted as follows:

Record: keyboard@stage-box._netaudio_chan._udp.local TXT

-   -   txtvers=2    -   rate=48000    -   bits=24    -   enc=1    -   nchan=4    -   id=16    -   nred=1

Mixer 112 also supports a redundant channel. Its primary data interface132 has address 169.254.28.12. Its secondary data interface 134 hasaddress 169.254.132.15. Locally, mixer 112 sends the following “createRX bundle’ messages from its APEC 126 to its APE 124:

Field Value Notes Destination address 169.254.28.12 Mixer’s primary datainterface address Destination port 26528 Interface   0 Primary dataNumber of channels   2 interface is #0 Map for slot 1   [8] Array withone element: RX channel 1 Map for slot 2   [11] Array with one element:RX channel 4

Field Value Notes Destination address 169.254.132.15 Mixer’s secondarydata interface address Destination port 28452 Interface   1 Secondarydata interface is #1 Number of channels   2 Map for slot 1   [8] Arraywith one element: RX channel 1 Map for slot 2   [11] Array with oneelement: RX channel 4

Each message configures one received packet stream to one of theinterfaces 132 or 134. The secondary interface 134 (#1) might use thesame port number as the primary interface 132 or a different one,depending on the APE 124 design. This example assumes that a differentport is chosen.

Just as mixer 112 must create two separate bundles on its APE 124, itmust create two separate dynamic bundles on stage-box 110. The followingmessages are sent to APEC 122 from the APEC 126:

Field Value Notes Destination address 169.254.28.12 Mixer’s primary datainterface address Destination port 26528 Interface   1 Primary datainterface is #0 Number of channels   2 TX channel for slot 1   16 ID ofkeyboard@stage-box TX channel for slot 2   17 ID of guitar@stage-box

Finally, stage-box 110 creates two bundles on the local APE 120 tofulfill these requests. The following is sent from the APEC 122 to theAPE 120:

Field Value Notes Destination address 169.254.28.12 Mixer’s primary datainterface address Destination port 26528 Interface   0 Primary datainterface (on stage-box) is #0 Number of channels   2 TX channel forslot 1   16 TX channel 1 TX channel for slot 2   17 TX channel 2

Field Value Notes Destination address 169.254.132.15 Mixer’s scondarydata interface address Destination port 26528 Interface   1 Secondarydata interface (on stage-box) is #1 Number of channels   2 TX channelfor slot 1   16 TX channel 1 TX channel for slot 2   17 TX channel 2

Multicast Redundancy

To support redundant multicast, the transmitter 110 creates severaldifferent 5 packet streams and advertises them as separate staticbundles associated with a single bundle name.

For example, to advertise two copies of bundle b1 and b2, one primary130 and one secondary 136, stage-box 110 would first claim a multicastaddress for each bundle. The primary bundle uses 239.254.46.46. Thesecondary bundle uses 10 239.254.98.147. For this example, assume bothuse the same port (29061).

Two service records (SRV) are created, one for each packet stream. Sinceeach packet stream is identically formatted, only a single TXT record isrequired.

-   -   Record: bl@stage-box._netaudio_bund._udp.local SRV    -   0 1 29061 46.46.254.239.mcast.local    -   Record: bl@stage-box._netaudio_bund._udp.local SRV    -   1 1 29061 147.98.254.239.mcast.local    -   Record: bl@stage-box._netaudio_bund.udp.local TXT    -   txtvers=1    -   rate=48000    -   bits=24    -   enc=1    -   nchan=4

If only a single (primary) interface is used, the “priority” field(which is represented as the first number) in the SRV is set 0. Anon-zero priority indicates that the bundle applies to a redundantinterface, in this case interface 1.

Decoding these bundle advertisements allows the receiver to configureappropriate bundles on each interface. The APEC 126 configures the APE124 to receive the primary bundle on the first primary interface 132 andthe second bundle on the secondary interface 134.

Buffer Management

Whether unicast or multicast protocol is used, the way that the receiverdevice 112 manages the duplicated packet streams is the same.

Referring to the data network 902 of FIG. 5, this shows that thetransmitter device 110 transmits two identical packet streams. Onepacket stream 904 is sent from the primary data interface 130 and thesecond packet stream 906 is sent from the first redundant interface 136.Both contain samples generated by the media channel connected to thekeyboard 144.

The first primary packet stream 904 is received by the receiver device,the amplifier 908, at the primary data interface 132. The secondredundant packet stream 906 is received by the amplifier 908 at thefirst redundant data interface 134. Each packet stream 904 and 906 isprocessed by the APE 124 in accordance with the instructions receivedfrom the APEC 126. Here, the APE 124 will process the received packetstreams 904 and 906 for playout by the speaker 142 which is connected tothe output channel 2 of the amplifier 908. Alternatively, the deviceconnected to the output channel 2 may not be a playout device, such as amixer or amplifier.

The APE 124 extracts samples from the received data streams 904 and 906and determines the output time of each sample based on the respectivetimestamp. The APE 124 then writes the samples to a buffer 910 based onthe determined output time before transmitting the samples to the outputchannel 2 for play out by the speaker 142.

The method of writing the samples to the buffer will now be describedwith reference to FIG. 6. Both packet streams 904 and 906 are processedindependently and the APE 124 requires no specific knowledge that theyare essentially exactly the same.

The samples of the keyboard media channel are extracted from the packetstream by the APE 124 and written 912 to the buffer 910 so that they arein sequential order for output in the buffer. The buffer is conceptuallydivided into intervals t0, t2, t3 . . . tn which are each of samplelength and each correspond to one output time. One sample is written toeach interval based on the respective output time. Once a sample iswritten to the last interval tn of the buffer 910 samples continue to bewritten to the first interval to over a previous sample that was writtenthere but has since been passed to the output channel 2 and played outby the speaker 142.

Since each sample that is received has an associated timestamp with anabsolute time reference the output time that corresponds to the absolutetime reference can be easily determined. In this example, identicalsamples must be passed to the output channel in synchronisation, as aresult the output time for each sample must also be the same. So, if asample is received out of order it is possible to write it to thecorrect interval since the correct interval can be selected based on theoutput time of that sample. If a sample belongs to a time interval thathas already been played out that sample will simply be discarded.

Both the first 904 and second 906 packet stream is processed in thismanner. Since the samples and their determined output times areidentical the same sample is written twice to the same interval. It doesnot matter whether the samples from the first 904 or second 906 packetstream are written to the buffer 910 first, the end result of thesamples temporarily stored in the buffer will be the same.

In this way, if a packet from the first packet stream 904 is lost intransmission from the transmitter device 110, the samples from theidentical packet in the second packet stream 906 is written to thebuffer 910. In this case, these samples are only written once to thebuffer. Of course, the reverse is possible where a packet is lost fromthe second packet stream 906 and instead only samples from the identicalpacket from the first packet stream 904 are written to the buffer 910.

Since the APEC 126 knows that packet streams 904 and 906 (morespecifically, a particular slot in each packet stream 904 and 906)contain identical data and in the message sent from the APEC 126 to theAPE 124 described above, it programs the APE 124 to unconditionally copyboth into the same buffer, the APE 124 does not need to decide whichpacket stream is “current” or “live”. The APE 124 processes and copiesboth on the same interval (location) in the buffer without considerationof which media stream 904 and 906 is processed and written first to thebuffer, both streams are simply processed in the usual way. This reducesthe complexity in managing systems that are able to transmit and receiveredundant packet streams. For example decision making on whether toactivate a fail over switch is no longer necessary. Once paths are setup, no further decision logic is required by APE 124 or APEC 126 unlessboth paths fail.

If samples are corrupted during transmission on the network then thosesamples, once identified, should be discarded. The duplicate mediapacket stream will ensure that the output buffer receives at least onecopy of the sample without any need to switch between the media packetstreams. Any transport-level error checking or error recovery isperformed before the sample data is written to the shared buffer.

The actual sample content of each packet in the media packet streams 904and 906 need not be identical. For example, the media channel, could bepacketized differently into the packet streams 904 and 906 so thatpackets from each stream do not contain the same samples. The method ofwriting the samples to the buffer will still be the same as eachidentical sample, no matter the position of its associated frame in thepacket, will share a common output time. When writing the samples to thebuffer the APE 124 will refer to the output time of each to determinewhich interval (location) the sample should be written to.

The invention can also allow for further redundant streams eachcontaining the same media channels. Each media packet stream would besent to a different data interface. Again the APE 124 would process allthe packet streams independently and extracted samples are written tothe same buffer for that output channel.

Of course, the samples 556 could be a mixture of one or more mediasources, such as a keyboard 144 and a guitar 140. Alternatively, a mixercould be provided to mix samples prior to being written to the buffer.

It will be appreciated by persons skilled in the art that numerousvariations and/or modifications may be made to the invention as shown inthe specific embodiments without departing from the spirit or scope ofthe invention as broadly described.

-   -   When using static bundles, channels can be assigned to bundles        in any convenient manner. It is also possible to implement        redundancy by creating specific bundles on specific interfaces.    -   Dynamic bundles are usually unicast. Static bundles are usually        multicast. If required, it is possible to configure dynamic        bundles as multicast or static bundles as unicast.    -   Physical channel inputs/outputs could also be implemented in        software, such as in the software of the mixer, they don't have        to be real physical plugs.    -   While these examples assume sampled audio data, the exact same        protocol mechanisms will work for any fixed-size periodic data        stream. Non-periodic or variable sized data can also be        supported with variations to the transport (packet & bundling)        mechanisms.    -   Assigning homogeneous channels to slots is an implementation        convenience. Non-homogenous channel media data with a common        sample rate can be identified in a frame using a start byte and        length.    -   MIDI is an example of non-periodic data. The same interface that        allows a user to abstractly route audio to audio and video to        video can route    -   MIDI to MIDI. Like periodic packets, MIDI packets would have a        timestamp, but there would not be the expectation of receivers        that units of MIDI data would arrive periodically. Non-periodic        data might need a periodic ‘keepalive’ message to distinguish        between a quiet and a non-functional stream. Non-periodic data        can be automatically aggregated as easily as periodic data as        long as there is a flag to say “none of this data in this        packet”.

The present embodiments are, therefore, to be considered in all respectsas illustrative and not restrictive.

The invention claimed is:
 1. A receiver device configured to receive atleast one of audio and video packet streams from a data network, thereceiver device comprising: a first data interface configured to receivea first audio or video packet stream comprising samples of an audio orvideo channel; a second data interface configured to receive a secondaudio or video packet stream comprising the samples of the audio orvideo channel; and a processor configured to extract samples from thefirst and second audio or video packet streams and to determine anoutput time for the extracted samples; a buffer configured totemporarily store the extracted samples for output; wherein theprocessor is further configured to cause the extracted samples to bewritten to the buffer based on the respective output time, such thatextracted samples having the same output time are written to the samelocation in the buffer.
 2. A receiver device according to claim 1,wherein the buffer is able to temporarily store a predetermined maximumnumber of extracted samples.
 3. A receiver device according to claim 1,wherein the buffer is able to temporarily store the extracted samples insequential order according to their respective output time.
 4. Areceiver device according to claim 1, wherein the output time is theplayout time.
 5. A receiver device according to claim 1, wherein thelocation is the storage space allocated to store one sample.
 6. Areceiver device according to claim 1, wherein a first extracted samplewritten to the location is written over a second extracted sample from adifferent packet stream previously written to the location.
 7. Areceiver device according to claim 1, wherein the first and secondextracted samples are identical.
 8. A receiver device according to claim1, wherein the buffer is associated with one output channel and eachaudio or video packet stream is directed to the same output channel. 9.A receiver device according to claim 1, wherein the receiver devicefurther comprises a third data interface configured to receive a thirdaudio or video packet stream comprising the samples of the media audioor video channel, wherein the processor further operates to extractsamples from the third audio or video packet stream and to determine anoutput time for the extracted samples, and to cause the extractedsamples to be written to the buffer based on the respective output time.10. A receiver device according to claim 1, wherein the processorfurther operates to detect samples that are corrupted and to preventthese corrupted samples from being written to the buffer.
 11. A receiverdevice according to claim 1, wherein all the samples contained in oneaudio or video packet of the first media packet stream are not allcontained in any single audio or video packet of the second audio orvideo packet stream.
 12. A receiver device according to claim 1, whereinthe first and second audio or video packet streams are received fromdifferent data interfaces of a transmitter device connected to the datanetwork.
 13. A receiver device according to claim 1, where the samplesof the audio or video channel each have an associated timestamp and theprocessor operates to determine the output time for the extractedsamples based on the respective timestamps.
 14. A method of receivingaudio or video packet streams from a data network, the methodcomprising: receiving a first audio or video packet stream comprisingsamples of a audio or video channel; receiving a second audio or videopacket stream comprising the samples of the media channel; extractingsamples from the first and second audio or video packet streams;determining an output time for the extracted samples; based on therespective output time of the extracted sample, writing each extractedsample to a buffer for output, such that extracted samples having thesame output time are written to the same location in the buffer.
 15. Amethod according to claim 14, wherein the step of writing each extractedsample to a buffer comprises writing the extracted samples in sequentialorder according to the respective output time of each extracted sample.16. A method according to claim 14, wherein the step of receiving thefirst audio or video packet stream is from a first data interface of atransmitter device connected to the data network and the step ofreceiving the second audio or video packet streams is from the first ora second data interface of the transmitter device connected to the datanetwork.
 17. A method according to claim 14, wherein the method furthercomprises sending one message to request that the first and second audioor video packet streams be received.
 18. A method according to claim 14,wherein the step of writing each extracted sample to a buffer compriseswriting a first extracted sample to a location and then writing a secondextracted sample from a different packet stream over the first extractedsample at the location.